An Exercise in Critically Evaluating Experimental Design: Can the Peak Performance Pack Benefit Adults of Every Age

 

Tested Studies in Laboratory Teaching, 2018, Volume 39

Lori Rose

Abstract

Nutritional supplement companies often tout their products as having been "clinically tested" and demonstrated to "benefit adults of every age." Bombarded daily with such advertising, students are expected to make informed decisions regarding the risks, benefits, and costs of nutritional supplements. This exercise will examine the "scientific evidence" presented on the internet by a supplement company. Participants are divided into groups, presented the materials provided publicly by the company, and asked to evaluate the experimental design used in each of two studies. Participants should evaluate the following: controls, sample size, placebo, single-blind, double-blind, definitions ("wellness," "benefit," "clinical trials"), dependent and independent variables. The evaluation should also consider the implications of peer-review and funding for the studies. Once completed, each group will share their evaluations with the entire class.

Keywords:  hypothesis, experimental design, peer review, critical thinking, placebo, double blind, clinical trial, variables

University of Wisconsin, Madison (2017)